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PREFACE 


Information  system  technology  has  revolutionized  how  modem  business  and  government  organizations 
operate.  That  same  technology  holds  great  promise  for  helping  to  improve  K-12  education,  but  fora  variety  of 
reasons  the  public  schools  lag  other  sectors  in  iaking  advantage  of  the  technology  that  is  already  available.  If 
technology  is  to  make  a  difference  in  public  education,  it  must  be  integrated  into  the  overall  curriculum  in  the 
schools,  and  it  must  he  implemented  in  ways  that  are  both  affordable  and  sustainable.  This  paper  argues  that  key 
steps  in  this  process  are  establishing  a  set  of  flexible  standards  for  educational  technology,  promoting  the 
sharing  and  reuse  of  educational  technology  materials,  and  creating  a  peer  review  process  for  the  selection  of 
educational  technology  products.  The  paper  concludes  by  describing  how  these  ideas  arc  being  pursued  in 
partnership  with  the  Springfield,  Massachusetts,  school  system. 

Dr.  Bans  M.  Horowitz  is  President  and  Chief  Executive  Officer  of  The  MITRE  Corporation.  Dr.  Peter  J. 
Negroni  is  the  Superintendent  of  Schools  in  Springfield,  Massachusetts.  Nelson  E.  Bolen  is  an  Associate 
Technical  Director  at  The  MITRE  Corporation. 
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INTRODUCTION 

We  believe  that  modem  information  system 
technology  — computers,  software,  communication 
networks,  etc.  —  can  make  an  important  contribu¬ 
tion  to  the  revitalization  and  improvement  of  K—  1 2 
education.  The  application  of  technology  to  educa¬ 
tion  is  not  a  new  idea,  but  the  results  to  date  have 
generally  been  less  than  originally  hoped.  The 
business  community,  government,  and  the  military 
have  been  leaders  in  the  development  and  applica¬ 
tion  of  information  system  technology,  including  its 
application  to  education  and  training  outside  the 
confines  of  the  public  schools.  Fortunately,  the 
schools  can  take  advantage  of  the  lessons  that  have 
been  learned  by  these  pioneers.  One  of  the  key 
lessons  is  that  if  the  technology  is  applied  in  a 
piecemeal  fashion  to  solve  individual  problems,  the 
result  w  ill  he  a  collection  of  individual  and  incom¬ 
patible  solutions  that  will  eventually  become 
unwieldy  and  unsupportable  and  will  have  to  he 
replaced  by  a  totally  new  system. 

We  need  to  help  the  public  schools  follow  a 
path  that  w  ill  address  two  key  issues  at  the  same 
time:  ( 1 )  how  to  make  effective  use  of  modern 
technology  as  an  integral  part  of  the  overall  educa¬ 
tional  process,  and  (2)  how  to  implement  that 
technology  in  the  schools  in  a  way  that  is  affordable 
anil  sustainable.  The  first  issue  lies  w  ithin  the 
educational  domain,  and  the  second  lies  within  the 
technical  domain.  Both  are  critical,  and  both  need  to 
be  addressed  concurrently  This  paper  explores  three 
basic  themes  for  dealing  with  the  issue  of  how  to 
implement  technology  in  the  public  schools.  These 
are  things  that  can  and  should  be  done  at  the  same 
time  as  educators  are  determining  what  technology  is 
most  useful  in  the  schools  and  how  it  can  be  inte¬ 
grated  into  the  total  curriculum.  Our  three  themes 
are: 

•  Flexible  standards  need  to  be  established  to 
guide  the  development  and  use  ot  educational 
technology,  particularly  educational  software. 
Standards  are  needed  for  the  students'  and 
teachers'  interactions  w  ith  the  software 
packages,  the  hardware  environments  in  which 


the  software  operates,  the  collection  and  storage 
of  data  that  can  be  used  to  help  assess  student 
learning,  and  the  collection  and  sharing  of 
descriptive  data  and  user  evaluations  of  educa¬ 
tional  technology  products.  Standards  can  make 
the  technology  easier  to  learn,  and  less  costly  to 
integrate  and  support.  They  can  also  make  the 
educational  market  more  attractive  to  product 
developers  by  providing  access  to  potentially 
large  markets  for  products  that  conform  to  the 
standards.  Finally,  standards  provide  the 
foundation  for  sharing  and  reusing  educational 
technology  materials  to  minimize  the  need  for 
custom  development  and  integration  by  local 
school  districts.  The  standards  must  be  suffi¬ 
ciently  flexible  to  permit  new  innovations  and 
to  provide  as  much  latitude  as  possible  in  how 
teachers  can  use  the  technology  in  their 
classrooms. 

•  A  peer  review  process  is  necessary  lot 
educational  technology  products,  analogous  to 
the  processes  that  already  exist  for  textbooks,  if 
technology  is  to  become  part  of  the  educational 
mainstream.  The  peer  review  process  w  ill  have 
to  address  software,  courseware,  multimedia 
resources,  etc.,  in  terms  of  standards  and  criteria 
that  cover  both  educational  quality  and  technical 
characteristics.  The  process  must  be  designed  to 
permit  appropriate  trade-offs  related  to  flex¬ 
ibility  w  ithin  the  standards. 

•  Neither  the  standards  for  educational  technology 
nor  the  peer  review  process  exist  today,  yet  they 
are  crucial  if  the  potential  benefits  of  the  wide¬ 
spread  use  of  that  technology  are  to  be  realized. 
We  plan  to  begin  the  process  of  creating  these 
key  elements  by  working  with  the  Springfield. 
Massachusetts,  public  school  system  to  become 
a  leader  in  the  development,  evaluation,  and 
refinement  of  the  necessary  sets  of  standards. 

We  also  believe  that  the  Commonwealth  of 
Massachusetts  can  create  a  peer  review  system 
for  educational  software  that  will  lead  to  a 
nationwide  role. 
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TECHNOLOGY  IN  PUBLIC  EDUCATION 

Technologv  is  becoming  increasingly  important 
for  the  public  schools,  both  as  a  tool  to  aid  the 
learning  process  and  as  a  subject  to  be  studied  in  its 
own  right.  Information  system  technology  — 
computers,  high-speed  worldwide  communication 
links,  videotapes  and  videodisks.  CD-ROMs 
(compact  disk  -  read-only  memory  ),  and  more  — 
have  led  to  dramatic  changes  in  the  way  business, 
industry,  and  the  government  operate.  The  applica¬ 
tion  of  this  technology  to  the  public  schools  has  been 
much  less  dramatic.  Education  is  inherently  a  labor- 
intensive  enterprise.  Labor  constitutes  nearly  93 
percent  of  the  cost  of  operating  the  educational 
system  in  this  country:  this  is  nearly  twice  the  labor 
cost  component  of  the  average  industry  .  It  is 
unrealistic  to  assume  that  technology  w  ill  replace 
teachers  in  the  educational  environment:  rather,  it 
will  supplement  and  extend  what  the  teachers  arc- 
able  to  do.  Over  time,  as  the  value  of  technology  in 
improving  education  is  demonstrated,  the  nature  and 
composition  of  the  classroom  and  the  role  of  the 
teacher  may  change. 

Computer- Aided  Instruction 

Throughout  the  past  30  years  there  has  been 
interest  in  using  computers  to  deliver  instruction  to 
students.  The  labels  have  shifted  from  the  teaching 
machines  of  the  early  days  to  computer-based 
training  (CBT i.  computer-aided  instruction  (CAI). 
computer-managed  instruction  (CMI).  and  the 
currently  emerging  integrated  learning  systems 
(ITS).  The  capabilities  range  from  relatively  simple 
page-turning  and  rote  drill  programs  to  highly 
interactive  multimedia  packages  and  an  emerging 
class  of  intelligent  tutors  that  combine  a  model  of  the 
student's  learning  process  with  an  expert's  subject 
matter  know  ledge  base  to  prov  ide  instruction  and 
coaching  that  is  tailored  to  the  indiv  idual  student.  In 
any  of  its  forms,  the  key  advantages  ot  computer- 
delivered  instruction  are  that  it  permits  the  individual 
student  to  progress  at  his/her  own  pace,  the  computer 
acts  as  an  infinitely  patient  individual  instructor,  and 
the  feedback  from  the  computer  to  the  student  is 
instantaneous  and  non- judgmental.  One  tiling  that 


seems  clear  is  that  it  works;  a  study  by  the  Hudson 
Institute  cites  20  years  of  research  that  shows  that 
computer-based  instruction  produces  at  least  30 
percent  more  learning  in  40  percent  less  time  and  at 
30  percent  less  cost. 

Simulations 

Computers  can  be  used  to  create  learning 
environments  that  go  beyond  the  computer-aided 
instruction  model.  The  computer  can  be  used  to 
represent  the  behavior  of  the  real  world  so  that  a 
student  can  learn  by  doing  —  by  performing 
experiments  and  try  ing  out  ideas  in  a  controlled  but 
realistic  environment.  For  example,  the  computer 
can  be  used  as  a  physics  laboratory  in  w  hich  the 
movement  of  mechanical  objects  is  modeled  in 
accordance  with  Newton's  laws  of  motion.  Experi¬ 
ments  can  be  conducted  with  these  simulated  objects 
much  as  they  could  be  conducted  w  ith  real  objects  in 
a  conventional  laboratory.  The  difference  is  that  the 
computer  simulation  permits  the  student  and  the 
teacher  to  expand  the  scope  of  their  experiments  to 
learn  more  about  the  law  s  of  physics.  The  experi¬ 
mental  setup  —  for  example,  the  number,  sizes, 
shapes,  mass,  and  positions  of  the  mechanical 
objects  —  can  be  quickly  changed  and  rerun  by 
changing  parameters  in  the  computer.  The  experi¬ 
ment  can  be  run  in  real  time,  or  it  can  be  run  in  slow 
motion  so  that  the  student  can  see  the  details  of  what 
is  happening.  The  experiment  can  be  run  in  a  variety 
of  env  ironments  —  at  sea  level  on  the  Earth's 
surface,  in  a  vacuum,  on  the  moon,  and  on  Jupiter  — 
to  show  the  effects  of  factors  such  as  gravity  and  the 
atmosphere.  The  computer  can  prov  ide  results  and 
feedback  in  a  variety  of  formats  —  text,  graphs,  or 
pictures  —  to  match  the  student  s  needs  and  mode  of 
learning.  The  computer  can  also  record  quantitative 
data  from  the  experiment  so  that  the  student  can 
analyze  it.  plot  it.  and  include  the  results  as  part  of 
the  lab  report.  Similar  computer-based  simulations 
can  also  be  used  for  subjects  that  are  governed  by- 
relationships  more  complex  and  less  understood  than 
the  law  s  of  physics  —  for  example,  the  stock  market, 
or  a  city.  Interactive  simulations  prov  ide  an  opportu¬ 
nity  for  students  to  develop  and  practice  problem¬ 
solving  skills  that  go  beyond  the  absorb-some- 
material-and-pass-a-tesl  model. 


V 


Curriculum  Management  and  Assessment 

There  is  grow  ing  concern  that  a  high  school 
diploma  should  signify  that  a  student  has  achieved  a 
certain  degree  of  competence  in  critical  areas  of 
study,  not  simple  that  the  student  has  passed  a 
prescribed  number  of  courses  and  standard  tests. 

Any  performance-based  curriculum  has  to  accom¬ 
modate  the  tact  that  not  all  students  learn  at  the  same 
rate  or  even  in  the  same  way.  hatch  student's 
educational  progress  needs  to  he  monitored  so  that 
problems  can  be  detected  earlv  and  the  instructional 
material,  instructional  approach,  and  instructional 
sapience  can  be  adjusted  on  an  indiv  idual  hasis  to 
best  serve  the  student's  needs.  Monitoring  and 
assessing  student  progress  is  an  inherent  element  in 
the  educational  process,  and  teachers  do  that  as  a 
normal  part  ol  their  job.  At  the  beginning  of  the 
school  year,  the  teacher  may  know  little  about 
individual  incoming  students  beyond  the  fact  that 
they  presumably  receiver!  a  passing  grade  in  any 
prerequisite  subjects.  The  formal  student  perfor¬ 
mance  database  today  consists  ol  the  teacher's 
gradebook  w  ith  grades  for  tests.  qui//es,  and 
possibly  Homework:  the  permanent  transcript  of 
course  grades:  anil  some  standardized  lest  scores. 

The  computer  oilers  opportunities  to  help  in  this 
area  by  maintaining  more  detailed  information  on 
each  student's  performance,  by  scanning  and 
analy/mg  that  data  to  detect  strengths  and  weak¬ 
nesses.  and  by  providing  rapid  feedback  to  the 
teacher  land  to  the  student  i  so  that  the  work  in  the 
classroom  can  be  adjusted  as  necessary  tooptmu/e 
the  learning  opportunities  for  each  student.  A 
computerized  curriculum  management  and  assess 
ment  system  could  handle  a  range  of  data  to  help  the 
teacher  and  the  student,  for  ev  "nplo.  besides 
keeping  the  student's  grade  lor  a  lest,  it  could  also 
keep  the  student's  answer  to  each  question  on  that 
test.  With  that  data,  diagnostic  analvses  could  be 
performed  automatically  to  Hag  topics  or  techniques 
that  a  student,  or  a  group  of  students,  had  difficullv 
mastering.  The  system  could  also  identify  additional 
or  alternative  material  that  could  be  presented  to 
students  to  help  them  master  the  specific  areas  where 
they  had  problems  Such  excursions  and  supple¬ 
ments  would  be  v.  ithin  the  boundaries  of  the 


established  curriculum  but  would  prov  ide  alterna¬ 
tive.  tailored  paths  through  the  material.  The 
extended  student  performance  database  would  be 
maintained  throughout  a  student's  school  career  and 
would  be  available  to  successive  teachers  to  pros  ide 
them  insights  into  the  accomplishments,  strengths, 
and  weaknesses  of  the  individual  students  at  the 
beginning  of  a  new  class. 

For  such  a  sy  stem  to  be  useful,  it  must  capture 
the  raw  data  on  student  performance  directly  rather 
than  require  the  teacher  or  support  staff  to  enter  that 
data  as  yet  another  task:  thus,  it  is  a  logical  adjunct 
to  computer-aided  instruction.  I  low  ;ver.  the  system 
must  do  more  than  simply  capture  and  store  detailed 
data  on  student  performance.  It  must  do  some 
preliminary  analy  sis  and  interpretation  of  that  data  to 
help  the  toucher  adjust  the  student's  instructional 
path  rather  than  simply  burdening  the  teacher  with  a 
mass  of  data.  The  sy  stem  must  also  prov  ide  Us 
output  quickly  and  directly  to  the  classroom  teacher 
so  that  the  feedback  can  be  used  to  plan  the  future 
work  In  the  classroom. 


FIJI  (  ATIONAI.  TKl  HNOl.OfiY  (UTSII)K 
THK  SCHOOLS 

The  business  community  and  the  military  have 
been  leaders  in  using  computers  and  other  technol¬ 
ogy  to  increase  their  productivity  and  to  tram  their 
workforces.  In  a  survey  ol  fortune  5(1(1  companies 
conducted  lour  years  ago.  54  percent  of  the  respon¬ 
dents  were  using  computer-assisted  training,  and  5  1 
percent  of  the  rest  planned  to  do  so  w  ithin  the  next 
year  or  two.  They  were  using  it  for  the  simple  reason 
that  it  paid  off  in  terms  of  money  ,  time,  and  perfor¬ 
mance.  Another  surv  ey  of  priv  ate  companies 
conducted  by  the  American  Society  for  Training  and 
Development  in  l*W()  reported  that  computer-based 
training  was  considered  to  be  the  most  cost-effective 
training  teclmologv  by  the  153  executives  who 
responded.  Figbtv  -one  percent  of  the  companies 
surveyed  were  using  CBT.  and  l»3  percent  planned  to 
be  using  it  within  three  years.  Examples  of  the  range 
of  applications  of  educational  technology  outside  the 
schools  include: 


•  Steelcase.  Inc.  uses  an  automated  learning 
center  with  computer-based  training  and 
multimedia  to  train  its  employees  to  use 
personal  computers  in  their  jobs.  The  center 
opera,  s  on  a  drop-in  basis  so  that  employees 
can  get  the  training  they  need  when  they  have 
tittle  available. 

•  Insurance  companies  such  as  Aetna  and 
Massachusetts  Mutual  use  interactive  video 
technology  and  computers  to  create  realistic 
simulations  to  train  accident  investigators  and 
life  insurance  salespeople. 

•  Domino's  Pizza  is  using  interactive  videodisk 
technology  to  train  workers  to  mix  pizza  dough 
to  ensure  product  quality  and  consistency. 

•  f  ederal  Express  uses  interactive  video  instruc¬ 
tion  tlVIt  to  train  data  processing  personnel.  A 
comparison  of  I VI  and  conventional  instruction 
showed  that  both  approaches  produced  compar¬ 
able  performance  but  IV I  took  (>0  percent  less 
time. 

•  Martin  Marietta  uses  computer-based  training  at 
individual  employee  workstations  in  a  new  . 
highly  automated  paperless  factory.  The 
computer  serves  as  an  on-the-job  "instructor" 
who  is  always  available.  24  hours  per  day. 

•  Shell  Petroleum  of  Ireland.  Pacific  Bel),  and 
federal  Express  use  interactive  videodisk 
technology  to  leach  defensive  driving  to  their 
truck  drivers. 

Computer-assisted  instruction  is  widely  used 
throughout  the  armed  services.  The  defense  depart¬ 
ment  has  the  problem  of  training  hundreds  of 
thousands  of  people  each  year,  ranging  front  new 
recruits  who  need  training  in  basic  skills  to  officers 
and  enlisted  personnel  who  need  to  learn  highly 
specialized  tasks.  Examples  of  the  use  ot  educational 
technology  in  the  military  services  include: 

•The  Defense  Language  Institute  in  Monterey. 
California,  uses  personal  computers  and 
teleconferencing  to  help  teach  basic  proficiency 


in  20  foreign  languages  to  3.000  students  each 
year. 

•  The  Air  Force  uses  computer-based  training 
with  dieit'/ed  audio  to  teach  2.0( K)  specialized 
cryptologic  linguists  each  year  in  12  languages. 
With  this  system,  the  student  washout  rate  litis 
been  cut  in  half,  from  10  percent  of  the  class  to 
5  percent,  while  the  student/instruct.. r  ratio  has 
increased  from  6: 1  to  10: 1 . 

•  The  Navy  is  using  CD-ROMs  and  personal 
computers  to  provide  225  different  courses  to 
sailors  at  sea. 

•  The  Navy  uses  personal  computers  w  ith 
interactive  videodisks  to  train  medical  corps 
stall'  in  various  health  and  health -related 
subjects  such  as  hematology  ,  dental  technology  , 
and  emergency  medical  treatment. 

•  The  Army  is  using  interactive  videodisk 
technology  to  train  military  officers  in 
interpersonal  leadership  skills. 

•  The  Army's  Job  Skills  Education  Program 
(JSEP)  uses  personal  computers  to  provide  basic 
academic  instruction  in  reading  and  computa¬ 
tion  for  Army  recruits.  The  same  program  is 
being  tested  at  several  civ  ilian  sites  to  help  teach 
basic  skills  in  mathematics,  reading.  English 

as  a  second  language,  and  other  areas  to 
immigrants  and  disadv  antaged  adults. 

•  The  Air  Force  is  developing  an  Adv  anced 
Training  System  that  vv  ill  consist  of  up  to 
35.000  networked  computer  workstations  at  six 
major  air  bases  to  prov  ide  training  in  more  than 
200  job  specialty  areas  to  as  many  as  175.000 
students  each  year.  This  system  will  use  the 
computers  not  only  for  the  delivery  of  instruc¬ 
tional  material  to  the  students  hut  also  for  course 
development,  student  management,  training 
resource  management,  and  training  evaluation. 

The  technology  exists,  and  it  works. 
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THK  RKAI.  WORLD  OF  THK  PI  ItLH 
SCHOOLS 

li  seems  Hear  that  technology  can  help  to 
improve  the  public  educational  system  in  a  number 
of  ways.  Possible  roles  range  from  acting  as  infi¬ 
nitely  patient  and  non- judgmental  individual  tutors 
to  changing  the  nature  of  weak  in  the  classroom. 
pro\  iding  access  to  large  repositories  of  information 
outside  the  conventional  classroom,  anil  maintaining 
detailed  databases  to  permit  teachers  to  assess  the 
progress  and  respond  to  the  learning  needs  of 
mdi\  idtial  students.  Main  of  these  ideas  are  not  new 
outside  the  educational  system,  and  information 
system  technology  has  Ivtd  far  more  impact  on 
business,  industry,  and  the  military  during  the  past 
20  years  than  h  has  had  on  education.  Therefore,  we 
need  to  look  at  what  lias  been  happening  with 
technology  m  the  public  schools. 

Computers  Are  Not  Knougli 

The  de\  elopment  of  the  low  -cost  personal 
computer  in  the  late  ll)7()s  made  it  possible  to  h-gin 
to  (nit  computers  into  the  classroom,  I’TAs  spon¬ 
sored  hake  sales  to  buy  computers,  and  the  business 
community  was  asked  to  contribute  more  computers 
or  the  money  to  buy  them.  Computer  labs  were 
created  in  the  schools,  and  computer  literacy  became 
a  high-priority  addition  to  the  school  curriculum. 

I  S.  schools  acquired  S2  billion  worth  of  personal 
computers  during  the  decade  ot  the  I  W)s.  The 
growth  has  been  rapid  in  recent  years,  and  today 
there  arc  more  than  three  million  computers  m  the 
public  schools.  By  I  WO.  >  vei  k'7  percent  ol  all 
public  schools  had  at  least  one  computer,  hi  Massa¬ 
chusetts.  the  numhet  ol  computers  m  the  public 
schools  grew  from  1 2.000  in  1 0X4  to  4K.000  in  lOXO. 
Nationw  idc.  the  ratio  of  students  to  computers  has 
dropped  from  125:1  in  NKT  to  20: 1  in  1WI. 

Howev  er,  during  this  same  period  standard  school 
performance  measures  such  as  SAT  scores  have 
remained  at  best  constant  or  have  dropped  slightly. 
Simply  putting  more  computers  in  the  schools 
doesn't  necessarily  improve  educational 
performance. 


Today  one  finds  a  variety  of  different  and 
incompatible  computers  in  the  public  schools  l  figure 
I ).  The  most  popular  machines  change  as  time 
passes,  reflecting  'he  market  dy  namics  and  rapid 
pace  of  development  in  the  personal  computer  field. 
Figure  1  shows  that  Apple  is  the  largest  single 
supplier  of  computers  for  schools.  Howev  er,  this 
aggregated  data  for  Apple  does  not  reveal  the 
emerging  shift  from  the  earlier  Apple  II  family  ol 
machines  toward  the  newer  and  fundamentally 
different  Apple  Macintosh  computers.  IBM  PC's  and 
IBM-compatible  clones  are  becoming  more  widely 
used  in  the  schools,  reflecting  their  dominance  in 
business  and  the  government.  This  diversity  of 
hardware  vendors  is  good  for  competitive  reasons, 
since  no  school  system  (and  no  business  or  govern¬ 
ment  agency  1  wants  to  become  locked  into  a  single 
supplier.  (Tn  the  other  hand,  the  diversity  of  com¬ 
puter  hards'  are  brings  w  ith  it  potential  problems  in 
training  students  and  teachers  to  use  the  different 
machines,  in  providing  technical  and  maintenance 
support,  in  connecting  the  machines  together  so  that 
they  can  communicate  with  each  other,  and  in 
providing  the  software  that  is  necessary  to  use  the 
computers. 


Percent  ot 
Installed  P’se 


f  igure  I.  Lducutionnl  Computer  Market  Share 


(  omputer  Software  —  Too  Much,  or  Not 
Knough? 

Everyone  reali/es  that  computer  liardw are  is  not 
very  useful  without  software.  At  first  glance,  there 
seems  to  be  plenty  of  educational  software  to  choose 
front.  One  organization  that  prepares  an  annual 
survey  of  softw  are  lor  k  12  applications  reports  that 
some  I  a .000  educational  computer  programs  have 
been  offered  since  it  began  its  surveys  in  1985. 
Educational  software  is  estimated  to  be  a  S500 
million  per  year  business  and  growing,  with  as  many 
as  900  companies  in  the  field.  As  one  might  expect, 
the  educational  and  technical  qua.ily  of  this  software 
varies.  Much  of  the  educational  so';  ■  are  concen¬ 
trates  upon  rote  drill  and  skill  practice;  there  is  less 
softw  are  available  that  deals  w  ith  concept  develop¬ 
ment  anti  demonstration,  hypothesis  testing,  and 
simulations  of  the  real  world  to  pros  itle  a  laboratory 
for  learning  t  figure  2  >.  Of  the  I  5.0(H)  educational 
computer  programs  that  the  organization  cited  earlier 
has  reviewed  during  the  past  six  years,  only  900.  or 
so \en  percent,  have  been  recommended  as  being 
gooti  products. 

No  single  educational  software  company 
dominates  the  field;  the  top  10  firms  accounted  for 
an  estimated  8200  million  out  of  the  total  sales  of 


S500  million  in  1990.  Many  educational  computer 
programs  are  developed  by  independent  program 
liters,  .aid  consequently  many  educational  software 
companies  function  more  as  publishers  than  as 
product  developers.  The  markei  is  also  high  I  x 
f  ragmented  ..nd  scattered;  each  of  the  estimated 
18.000  school  districts  in  '.lie  country  makes  its  ow  n 
selection  and  purchase  decisions.  There  are  no 
federal  or  state  standart. for  educational  software, 
either  in  terms  of  educational  content  or  technical 
design  and  implementation.  With  .  urge  number  of 
suppliers  (most  of  them  small),  a  wide  range  of 
computer  hardw  are  in  the  schools,  a  fragmented 
market,  and  no  overall  standards  or  guidelines,  it  is 
not  surprising  that  educational  software  consists  of  a 
large  number  of  pieces,  some  good  and  some  not  so 
good,  that  don't  necessarily  fit  together  i:.  either  the 
educational  or  technical  sense. 

Staff  Training  and  Invo.vement 

The  current  average  of  somewhat  more  than  one 
computer  per  20  students  means  that  there  is  on  the 
order  of  one  computet  per  class.  On  the  other  hand, 
there  are  estimates  that  only  between  20  and  5(1 
percent  of  the  nation's  more  than  two  million 
teachers  use  computers  in  their  work.  It  is  unlikely 
that  a  teacher  will  use  technology  effectively  in  the 
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classroom,  oven  if  il  is  available,  il'  he/she  has  not 
boon  thoroughly  trained  in  how  to  use  it  and  does  not 
feel  comfortable  using  it  in  the  presence  of  students. 
Il  is  also  unlikely  that  the  technology  will  be  avail¬ 
able  to  the  teacher  in  the  classroom  if  the  school 
administrators,  school  committees,  and  thecommu- 
mtv  .it  large  tlo  not  understand  how  it  contributes  as 
an  integral  part  of  the  learning  process. 

Several  vears  ago.  it  w as  estimated  that  only 
about  one-third  of  till  K  -12  teachers  had  ev  er  had  as 
mtk  It  as  lit  hours  of  computer  training,  liven  if  the 
teas  hers  have  hail  some  basic  computer  training, 
thev  lace  llie  problem  ol  sorting  through  the  hun¬ 
dreds  ot  thousands  of  educational  softw  are  programs 
that  are  available  to  find  something  that  is  high 
i|tialitv  and  iclcv ant  to  their  curriculum,  and  that 
mats  lies  their  teaching  style  --  if  they  are  involved 
in  du'  selection  process  at  all.  Thus,  it  is  not  surpris- 
i'ia  that  teacher  training  is  one  of  the  consistent 
problems  cited  in  studies  of  w  hy  the  promise  of 
educational  technology  remains  largely  a  promise: 

!  .-vs  ic.ishsTs  liavs-  louiis!  ways  locxp'oil  tils' 
cia'mnnis.  puts'pli.il  wlin  li  interactive  technologies 
■tts-i  I  lie  computer  can  help  shift  the 
u  h.'i  > . >ls-  liom  s’dtis.ti it ai  slisps'iiscr  to  coach. 

■i;. .Iric  and  siisoiiiaeinc  cash  student  lit  become 
r  1. 1 iv  c  partis  ip. mi  in  hi'  or  her  uvv  n  learning 

I  Its-  piose"  by  vvliisll  teachers  appropriate 
tcs  liii.ilogy  is  more  coinplcv  than  that  by  uliisil 
kas  Ik  a '  ail.  >pt  ollici  s  1 1 . 1 1 1  e  s*  s  Initial  tears 
iei:.udiuc  lei linology  may  neesl  to  Iv  overcome 
ketoi  e  leas  hci  s  leel  in  sontrol.  I  laming  vv  iih 
.  an  pillars  is  an  ongoing  process  llt.il  takes  place 
at  v  ary  mg  lev  els.  slepenilmg  upon  the  teacher's 
I  s'  '|>oiisi  l>i  1 1 1  is-s  ansi  tils’  vsav  leclmology  is  to  ho 
iiss'.l  leaslicrs  nsvil  opp.vl  i  ill  it  is*'  lor  practise 
vs  ith  the  s  onipiiici .  vs  uh  s  onn lining  support  Irom 
trainers  or  eoinpuls'i  using  peers.  Once  teacher' 
leel  s  onilorMhle  vs  ith  the  computer  as  a  lost!  to 
help  iliem  do  then  |oh.  they  look  tor  vs  ay  >  In 
mti'L'ials  it  i ills t  their  existing  eurneulum  and  seek 
oppoiiiinilie'  to  slo  things  previously  impossible  in 
ilk1  s  lassroom. 

I  s'.is  lis'is  use  computers  in  vsay  s  that  work 
Iv'l  w  ith  then  own  teas  lung  sty  lev  aikl  methods. 


hut  ihose  sty  les  evolve  as  teachers  gam  more 
computer  experience. 

"The  very  opportunities  openeil  hy  the 
computer  can  create  more  work  lor  the  te  ishei. 
making  the  job  hariler  initially.  Although  the 
computer  can  minimi/e  some  administrative 
chores  ansi  ease  elassros'rn  discipline,  other  tasks 
which  accompany  computer  use  i indie iduali/ing 
lessons,  matching  software  to  the  curriculum, 
scheduling  student  computer  tune,  monitoring  use. 
prov  idiug  assistance,  and  troubleshooting  I  add  a 
net  burden  to  ills-  teacher  s  time  in  the  short  term. 

"Any  further  investment  in  technology  for 
education  must  factor  in  teacher  training  and 
support,  whether  that  effort  is  focused  on  a  low 
speeiali/ed  teachers  or  on  all  teachers.” 

Power  Oil  '  Ven  Tools  / or  hut  hiioj  oinl  l.carniirr. 

Congress  of  the  l  nited  States.  Office  of  Technology 

Assessment.  September  loss 

l  'mil  the  classroom  teachers  have  sufficient 
training;  to  feel  comfortable  using  modern  technol¬ 
ogy.  it  will  not  become  an  integral  part  of  the 
learning  process  in  the  schools.  Nobody  claims  that 
computers  will  reduce  the  need  for  teachers.  The 
teachers  w  ill  still  be  in  charge  of  their  classes, 
although  their  primary  role  may  gradually  shift  front 
delivering  information  to  overseeing  and  managing 
the  learning  process.  Information  system  technology 
has  demonstrated  amazingly  rapid  grow  th  and 
change  during  the  past  30  years,  and  that  pace  is 
unlikely  to  slow  down  in  the  foreseeable  future. 
There  will  be  new  things  to  learn  and  to  try  out.  and 
training  will  be  a  continuing  challenge.  Formal 
training  is  expensive  and  time-consuming,  and  so  the 
need  is  for  educational  software  that  is  user  friendly, 
w  ith  a  standard  look  and  feel  to  minimize  the  need 
lor  retraining  each  time  a  new  software  package  or  a 
new  machine  is  introduced  into  the  classroom. 

The  Schools  Are  Not  Rich 

The  public  schools  clearly  do  not  drive  the 
development  or  application  of  information  system 
technology.  While  ITS.  schools  max  have  acquired 
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three  million  personal  computers  at  a  cost  of  52 
billion  during  the  past  10  \ears.  that  is  a  small 
fraction  of  the  45  million  personal  computers  that 
has e  been  purchased  by  private  businesses  and  the 
government  during  the  same  period.  The  5500 
million  per  war  educational  software  market  mas 
seem  substantial  until  it  is  compared  to  the 
estimated  550  billion  per  sear  that  the  defense 
department  spends  on  software.  A  marketing 
research  studs  in  OHIO  indicated  that  the  tspical 
public  school  ssould  spend  only  555  per  student  — 
less  than  one  percent  of  its  budget  on  information 
technology  during  the  lOqo-lWl  academic  year.  In 
fact,  the  public  schools  are  not  even  the  dominant 
market  for  training  materials.  The  total  spending  on 
public  schools  in  |000  was  approximately  5200 
billion:  during  the  same  period,  business  and 
industry  spent  S2I0  250  billion  for  training.  The 
business  community  has  found  that  computer-based 
instruction  pays  oil:  ssorker-education  departments 
ot  l  .S.  employers  are  noss  spending  an  average  of 
.hi  percent  of  their  in-house  education  budgets  on 
computer  based  instruction  about  '00  times  more 
than  the  public  schools  spend  on  cotnpu'  T  hardware 
and  soitwarc  tor  eilucation. 

While  computer-aided  instruction  has  been 
show n  to  be  effective,  it  is  also  expensiv  c  in  terms  of 
initial  development  costs.  Depending  upon  the 
nature  of  t he  subject  matter,  the  degree  of  student 
interaction  and  branching  that  is  provided,  and  the 
evtent  to  which  multimedia  resources  arc  used,  the 
amount  ol  development  time  required  to  create  one 
hour  ol  instruction  to  be  delivered  v  ia  computer 
ranges  Irom  IDO  hours  to  1 .000  hours  or  more.  This 
development  cl  fort  requires  skills  in  both  the 
mtormalion  technologies  to  be  used,  and  the  subject 
matter  to  be  taught  At  tv  picul  labor  rates  for  high- 
technology  industries,  the  cost  ol  developing  one 
hour  ol  "courseware"  (the  instructional  materials 
lh.it  are  created  lot  presentation  to  a  student  using  a 
computet  i  can  range  Irom  S5.000  to  S50.000  or 
more.  At  these  rates,  the  development  cost  for  the 
courseware  for  a  one  semester  course  might  range 


from  S50.000  to  hundreds  of  thousands  of  dollars. 
Indiv  idual  school  systems  hav  e  neither  the  monev 
nor  the  market  potential  to  relv  upon  custom-built 
educational  software  for  their  local  needs.  Clearlv . 
the  development  costs  need  to  be  spread  over  as 
large  a  user  base  as  possible,  hoi  example,  if  a 
package  that  cost  S100.000  to  develop  is  used  hv 
500  schools,  its  cost  is  only  5200  per  school,  and  its 
value  may  span  many  courses  and  wars  of  use.  The 
schools  will  have  to  find,  adapt,  use.  and  share 
standard  educational  software  and  courseware, 
including  that  developed  for  the  huger  commercial 
and  militarv  markets. 

Nobody  Is  In  Charge 

There  is  no  ov  erall  locus,  leader,  or  manager  for 
the  application  of  technology  in  the  public  schools. 
The  majority  ol  the  funding,  and  therefore  the 
control  over  what  will  be  purchased  and  used  in  the 
schools,  comes  from  the  50  state  and  IX.000  local 
governments  that  operate  the  schools.  In  I OXO- 1 ooo. 
only  six  percent  of  the  estimated  5200-21 5  billion 
annual  budget  for  the  public  schools,  or  512  -15 
billion,  came  from  the  federal  Department  of 
education,  and  as  little  as  51  -10  million  of  that  total 
may  have  been  devoted  to  the  application  of  technol¬ 
ogy  to  education.  In  contrast,  the  Department  of 
Defense  spends  on  the  order  of  5200  million 
annually  on  research  related  to  high-tech  teaching 
and  learning.  There  arc  of  course  many  initiativ  es  in 
the  individual  states  and  local  schools  to  applv  new 
technology.  These  range  front  simply  putting  more 
computers  in  the  classroom  to  installing  satellite 
communication  terminals  to  support  "distance 
learning"  and  building  model  "schools  of  the  future" 
with  multimedia  technology  and  networked  comput¬ 
ers  in  every  classroom.  These  localized  initiatives 
are  certainly  helpful,  but  they  run  the  risk  of  being 
fragmented  and  duplicative  in  whole  or  in  part.  In 
the  absence  ot  standards  tor  the  development  and 
integration  ot  educational  software,  it  is  unlikelv  that 
the  products  of  local  initiatives  will  he  usable  and 
supportable  throughout  entire  states  or  the  nation  as 
a  w  hole. 
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THK  IMPORT  \N(  K  OF  STANDARDS 

The  business  community  anil  the  lederal 
government  have  been  leaders  in  the  development 
and  application  of  advanced  information  system 
technologv  over  the  past  311-4(1  seats.  During  that 
peril'll  tile's  have  gone  through  at  least  four  genera¬ 
tions  of  teehttologs  and  system  architectures,  starting 
with  the  original  large  mainframe  vacuum-tube 
computers  that  operated  in  a  batch-processing  mode 
and  progressing  through  transistorized  computers, 
lime-sharing  systems,  and  minicomputers  to  the 
current  generation  of  personal  computers,  personal 
workstations,  file  servers,  and  host  processors  a)' 
connected  by  communication  networks.  The  public 
schools  are  much  less  advanced  in  this  arena  and 
lias  e  an  opportunity  to  lake  adv  antage  of  some  of  the 
lessons  that  base  been  learned. 

< )pcn  Systems 

It  is  unrealistic  toespcct  that  computers  built  by 
a  single  nunulacturer  will  eventually  be  the  only 
ones  to  be  used  in  the  classroom.  Competition 
among  different  companies  is  responsible  for  many 
of  die  advances  in  the  performance  of  information 
systems  and  the  reductions  m  the  cost  ot  the  prod¬ 
ucts.  No  consumer  public  school  system,  bust 
ness,  or  government  agency  wants  to  become 
locked  into  a  single  source  of  supply .  furthermore,  it 
is  unrealistic  to  assume  that  computers  built  by  a 
single  manufacturer  will  be  the  best  choice  for  all 
applications,  finally,  the  rapid  advances  in  comput¬ 
ers  and  associated  equipment  will  continue,  and 
consequently  paths  tor  upgrading  current  equipment 
must  be  available.  I  herelore.  the  prelerred  situation 
is  to  be  able  to  tuts  and  match  hardware  from 
different  vendors  and  replace  individual  pieces  ol 
equipment  vv hh  newer,  more  capable  ones  as  they 
become  available  without  having  to  scrap  everv thing 
else.  This  situation  can  he  achieved  with  an  "/><■» 
wvtcm  mi  liih't  litre.  The  open  system  philosophy  is 
in  contrast  with  earlier  closed  system  architectures 
and  proprietary  designs  that  individual  computer 
manufacturers  developed  to  gain  and  maintain  a 
competitive  adv  antage. 


I  lie  kev  step  to  building  open  sv  stems  is  to 
standardize  the  interlace-,  not  necessarily  the 
hardware  itself  The  interlaces  that  are  important  are 
the  interlaces  between  individual  pieces  of  equip¬ 
ment.  the  interfaces  between  the  computet  hardware 
and  its  software,  the  inlet  laces  with  communication 
links,  and  the  interfaces  w  ith  the  users.  This  leads  to 
standard  programming  languages,  standard  computer 
operating  systems,  standard  representations  and 
formats  for  data  storage,  standard  database  access 
languages,  standard  mechanisms  for  the  protec  tion 
of  sensitive  data,  and  standard  communication 
protocols.  Individual  educational  software  packages 
will  operate  within  this  structure.  Industry  and  the 
federal  government  have  already  come  to  the 
conclusion  that  open  sy  stem  architectures  are  the 
right  approach  for  the  future,  and  they  have  suffi¬ 
cient  market  dominance  to  force  the  hardware  and 
software  vendors  to  offer  products  that  w  ill  work  in 
an  open  env  ironmenl.  The  public  schools  need  to 
take  advantage  ol  this  approach  and  the  products  that 
support  it.  There  arc  no  open  system  standards  for 
the  educational  market  yet.  but  they  will  he  neces¬ 
sary  and  will  most  likely  be  closely  related  to  the 
standards  being  implemented  for  the  commercial  and 
government  markets. 

Sharing  and  Reuse 

Individual  school  systems  cannot  afford  the 
custom  dev  elopment  and  integration  of  educational 
software  for  their  own  use.  file  same  statement  can 
obviously  be  made  about  textbooks,  and  no  school 
system  expects  to  develop  its  own  textbooks.  The 
alternative  to  custom  dev  elopment  is  the  use  of 
standard,  compatible  products  that  can  be  used  by 
many  schools.  The  need  for  standards  is  ohv  ions; 
they  permit  development  costs  to  be  spread  over  a 
large  number  of  users,  and  they  ensure  that  the 
products  meet  at  least  a  minimum  set  of  require¬ 
ments.  Standards  are  beneficial  to  the  producers  as 
well:  products  that  meet  the  standards  have  an 
inherent  "seal  ol  approval "  and  access  to  a  poten¬ 
tially  very  large  market.  There  alreadv  are  standards 
and  processes  lor  the  creation  and  selection  of 
textbooks  to  support  v  arious  courses  and  curricula. 
No  standards  and  selection  processes  comparable  to 
those  for  textbooks  exist  vet  for  educational  soft- 


ware,  and  an  organization  and  mechanism  to 
establish  them  is  not  in  place.  We  need  to  find  a  way 
to  create  the  necessary  standards  and  processes  if 
computer  software  and  courseware  arc  to  become  an 
integral  part  of  the  mainstream  learning  process  in 
the  public  schools. 

There  arc  already  a  number  of  sources  of 
educational  softw  are.  They  include  commercial 
developers  and  publishers  of  products  for  the  K  1 2 
education  market,  other  school-,  industry  (which  has 
made  major  investments  in  technology  for  training), 
and  various  departments  end  agencies  ol  the  federal 
government  t particularly  the  defense  department 
w  hich  has  been  a  leader  in  the  development  and 
application  of  computer-aiiied  instruction).  The  open 
system  architecture  that  has  been  described  provide . 
a  framework  that  will  permit  hardware  and  software 
from  different  sources  to  be  used  in  an  integrated 
manner.  While  this  open  framework  is  necessary,  it 
is  not  enough.  A  potential  user  -  a  classroom 
teacher  or  a  student  —  needs  access  to  the  materials 
that  already  exist.  This  implies  a  need  for  databases 
and  repositories  that  prov  ide: 

•  Information  on  what  is  available,  who  uses  it. 
and  how  to  get  more  information  —  for 
example.  «nal  software  is  available  for  an  IBM 
PC  that  prov  ides  instruction  anil  problems  in 
trigonometric  identities,  or  what  videixlisks 
include  -till  or  motion  images  illustrating  oil 

spills. 

•  An  assessment  of  the  quality  and  educational 
utility  of  products  and  resources  that  are 

av  ailable  sort  of  a  Consumers  Union  for 
educational  software,  courseware,  and  other 
materials.  The  assessment  has  to  be  in  terms  of 
standard  performance  criteria  and  has  to  be 
based  upon  real  experience  by  real  users 
students,  teachers,  and  school  administrators. 

The  assessment  needs  to  include  performance 
measures  (metrics)  as  well  as  subjective 
evaluations.  In  addition  to  covering  the 
educational  value,  the  assessment  needs  to  cover 
the  technical  design  and  implementation  of  the 
product. 


•The  material  itself  —  software,  courseware, 
video,  audio  —  in  a  form  and  format  that  is 
directly  usable.  Access  for  demonstration  and 
evaluation  should  be  possible. 

These  databases  and  repositories  need  to  he 
comprehensive  and  easily  accessible  to  the  end  users 
—  the  teachers  w  ho  are  planning  and  preparing 
lessons  and  courses,  and  the  students  who  are  doing 
projects  or  seeking  supplementary  information  on  a 
subject.  The  materials  also  have  to  be  easy  to  use 
once  they  have  been  found,  which  leads  to  the  issue 
of  user  interfaces. 

User  Interfaces 

If  computers  arc  to  be  used  effectively  in  the 
classroom,  the  users  —  the  teachers  and  students  - 
must  he  trained  to  use  them  and  must  find  them  easy 
to  use.  The  need  for  open  system  architectures  and 
the  ability  to  use  hardware  from  different  vendors 
has  already  been  stressed.  Thus,  the  students  may 
find  that  they  are  using  different  computers  as  they 
move  from  one  subject  to  another,  from  one  grade  to 
another,  or  from  one  school  building  to  another. 

Five'll  if  the  same  hardware  is  used  in  all  subjects, 
grades,  and  buildings,  the  software  packages  w  ill 
most  likely  be  different.  While  this  diversity  takes 
advantage  of  the  benefits  of  the  competitiv  e  market¬ 
place.  it  brings  with  it  the  need  to  train  teachers  anil 
students  how  to  use  each  software  package  on  each 
machine.  The  costs  and  lost  time  associated  with  this 
retraining  and  the  potem  d  for  errors  as  the  teacher 
or  student  moves  from  one  application  to  another 
can  easily  make  the  technology  more  of  a  burden 
than  a  useful  tool.  To  minimize  such  problems, 
special  attention  has  to  be  given  to  the  interface 
between  the  computer  and  its  users. 

When  typew  riters  first  began  to  appear  in 
offices,  the  importance  of  a  standard  keyboard  was 
quickly  recognized.  All  ty  pewriter  manufacturers 
adhere  to  a  standard  layout  for  the  basic  keys.  The 
user's  interface  w  ith  a  computer  is  more  complex 
than  a  typewriter  keyboard  (although  a  standard 
keyboard  is  frequently  an  important  part  of  the 
interface).  The  computer  interface  involves  what  the 
user  sees  on  the  computer  display  anil  how  he/she 


can  interact  with  that  display  to  control  the  operation 
ot  the  machine.  The  two  critical  characteristics  arc 
that  the  user  interlace  should  he  easy  to  use  (user 
friendly  t  and  consistent  from  one  application  to  the 
nest.  Tser  friendly  interfaces  permit  the  teacher  and 
the  student  to  interact  with  the  machine  by  making 
choices  from  "menus"  ol  options,  by  selecting  things 
through  pointing  at  pictures  of  objects  (icons),  and 
b\  other  similar  intuitive  actions.  Interfaces  that 
require  the  user  to  master  an  abstract  command 
language  are  less  user  friendly,  require  more  time  to 
learn,  and  require  continued  practice  to  maintain 
proficiency.  Consistency  means  that  the  user 
interfaces  for  different  applications  should  have  a 
similar  look  and  feel  and  produce  similar  results  for 
similar  actions  so  that  a  person  who  knows  how  to 
use  one  application  does  not  have  to  start  all  over 
again  to  learn  to  use  another,  l  or  example,  some 
computers  and  software  packages  make  extensive 
use  of  function  keys  I'T  keys’  )  to  control  process¬ 
ing.  If  w  ith  one  application  the  I  T  key  causes  the 
contents  of  the  current  display  to  be  printed  (saved) 
while  with  another  application  the  1-4  key  causes  the 
current  information  to  be  erased  (destroyed),  the 
opportunities  for  user  confusion  and  error  are 
obvious.  The  principles  and  standards  of  good  user 
interface  design  have  been  learned  from  experience 
and  can  be  applied  to  educational  software  to  help 
reduce  the  training  for  new  programs  anil  to  let  the 
teachers  and  students  concentrate  on  the  subject 
matter  rather  than  on  how  to  cope  with  the  computer. 

The  interface  between  the  computer  and  the 
teachers  and  students  can  be  thought  of  as  the  front 
end  the  part  that  is  immediately  v  isible  to  the 
users.  As  technology  becomes  an  integral  part  of  the 
school  env  ironment,  individual  computers  and 
software  packages  will  not  be  used  in  isolation. 
Instead,  the  machines  will  be  connected  by  commu¬ 
nication  networks  so  that  students  can  work  together 
cooperatively  on  projects  and  teachers  can  monitor 
student  progress.  A  computeri/ed  curriculum 
management  and  assessment  system  was  described 
earlier  in  this  paper.  Tor  such  a  system  to  be  useful, 
it  must  capture  data  on  individual  student  perfor¬ 
mance.  This  becomes  easier  when  computers  are 
also  used  to  deliver  instructional  material  and  to  test 
the  student’s  mastery  of  that  material.  In  such  an 


environment,  links  between  the  computer-aided 
instruction  system  and  the  computeri/ed  curriculum 
management  and  assessment  system  are  obv  ious  and 
necessary.  Again,  standard  interfaces,  but  not 
necessarily  common  hardware  and  software,  are  the 
key.  These  back  end  interfaces  are  not  directly 
apparent  to  the  students,  but  they  are  important  if  the 
teachers  are  to  have  direct,  timely  access  to  indi¬ 
vidual  student  performance  so  that  the  instructional 
process  can  be  tailored  to  meet  individual  needs  in 
time  to  make  a  difference. 

Technical  Support 

The  large-scale  introduction  of  technology  into 
the  public  schools  means  that  an  infrastructure  of 
computers,  software,  communications  networks,  and 
related  equipment  must  he  installed,  integrated, 
operated,  and  maintained  to  keep  it  working  effec¬ 
tively  .  The  need  for  this  kind  of  technical  support  is 
well  recognized  in  the  business  and  government 
organizations  that  already  have  large  automated 
information  systems.  Computer  manufacturers  and 
independent  companies  routinely  provide  the 
necessary  technical  support  services  —  for  a  fee. 

The  public  schools  are  never  likely  to  he  able  to 
afford  professional  engineering  services  at  a  rate  of 
$100,000  or  more  per  stall  year.  Therefore,  we  need 
to  find  other  ways  to  help  the  schools  install, 
operate,  and  maintain  their  technology  infrastructure 

The  things  that  have  already  been  described  will 
help.  Open  system  architectures  will  minimize  the 
problems  associated  with  installing,  adding,  and 
replacing  hardware.  Standards  tor  educational 
software  together  with  databases  that  identity  what  is 
available  and  how  it  performs  will  case  the  selection 
and  integration  process.  Consistent,  user  triemllv 
interfaces  between  the  software  and  the  teachers  and 
students  will  reduce  t’  e  retraining  load  .is  new 
software  is  brought  into  use  These  steps,  in  conjunc 
lion  with  technology  traimng  tor  teachers  and  other 
staff,  may  create  a  situation  in  which  much  ol  the 
necessary  technical  support  can  be  provided  bv 
personnel  in  the  schools  Tor  example,  one  or  a  lew 
teachers  m  a  school  might  become  the  on  site 
computer  experts  and  mentors  tor  the  other  teachers 
and  students  in  that  school  Thcv  would  lx-  the  ones 


who  answer  questions  when  problems  arise,  and  they 
would  be  the  ones  who  first  learn  how  to  use  a  new 
software  package  and  then  show  others  in  the  school 
how  to  use  it.  This  approach  won't  work  it  the  on¬ 
site  technical  support  role  is  simple  added  on  top  of 
those  teachers'  existing  workload,  so  some  accom¬ 
modation  such  as  additional  compensation  for  extra 
time  and/or  a  reduced  teaching  load  will  be  neces- 
sarv.  Other  possibilities  exist  within  the  context  ol 
the  xocational  high  schools.  Computer  installation 
and  repair  is  a  major  industry  that  will  continue  to 
grow,  and  the  vocational  schools  need  to  train 
students  to  enter  that  field.  Vocational  students  could 
provide  technical  support  for  school  computers  and 
communication  networks  as  the  hands-on  part  ol 
their  training,  anil  that  practical  experience  should 
increase  their  value  to  potential  employers  when 
they  graduate. 

(iKT  UMi  S  I  \K  I  I  I) 

We  began  this  paper  In  observing  that  technol¬ 
og  v  is  becoming  increasingly  important  lor  the 
public  schools,  both  as  a  tool  to  aid  the  learning 
process  and  as  a  subject  to  be  studied  m  its  own 
right.  I  he  application  ol  information  system 
technology  in  other  areas  during  the  past  2o  .'0 
vears  has  hopefully  taught  iis  some  lessons  The 
historical  path  has  been  expensive  and  slow.  The 
process  began  by  stimulating  the  demand  and 
applying  the  new  technologv  to  specific  problems  on 
an  thl  In >i  basis.  Vendors  developed  and  promoted 
proprietary  products  for  their  competitive  advantage. 
Both  products  and  applications  grew,  and  the  result 
after  a  while  was  an  incompatible  collection  ol 
"stovepipe"  systems  that  become  increasingly  more 
difficult  to  integrate,  expensive  to  maintain,  anil 
technologically  obsolete  as  new  products  were 
developed  that  offered  more  capability  but  could  not 
be  integrated  with  what  the  users  already  had. 
Patchwork  fixes  were  required  to  keep  things 
running  and  to  respond  to  new  needs.  eventually.  the 
need  for  standards,  commonality,  and  an  overall 
architecture  and  support  infrastructure  was  recog¬ 
nized.  and  this  led  to  the  wholesale  replacement  of 
the  earlier  system  and  the  investment  in  a  new 


generation  ol  hardware  and  software.  I  ntortunately . 
the  replacement  of  the  earlier  generation  ol  sy  stems 
is  neither  quick  nor  cheap.  The  conversion  to  open 
sv stems  and  standard  products  may  take  5  10  ycais. 
during  which  time  portions  ol  the  older  system  have 
to  be  kept  in  operation  and  supported  while  the  new 
sv  .stein  is  being  put  into  place.  The  conversion  or 
replacement  of  the  software  is  more  difficult  and 
cv vst I v  than  the  replacement  of  the  hardware.  The 
public  schools  do  not  have  to  start  at  the  beginning 
and  learn  the  same  lessons  on  their  own.  Open 
svstem  architectures  and  standard  interfaces  sharing 
and  reusing  educational  software  from  many 
sources,  consistent  and  user  friendly  computet 
interlaces,  and  a  technical  support  infrastructure  that 
takes  full  advantage  of  resources  in  the  schools 
themselves  can  be  put  into  place  at  the  same  time 
that  the  schools  are  integrating  technology  into  the 
educational  process  ami  curriculum.  We  need  to 
demonstrate  that  this  approach  will  make  a 
difference. 

Start  at  the  Local  Level 

The  federal  government  is  not  the  major  source 
ot  funding  for  K  12  education  and  does  not  cur¬ 
rently  have  a  role  or  mandate  for  establishing 
standards  for  educational  technology.  In  fact,  the 
federal  government's  current  approach  is  to  encour 
age  local  initiatives  and  private  industry  to  create 
new  "break  the  mold  "  schools,  evaluate  the  results, 
and  then  decide  which  ol  the  new  ideas  should  be 
replicated  in  other  schools.  T  herefore,  we  need  to 
start  at  the  local  level  as  well.  We  have  selected  the 
Springfield.  Massachusetts,  pubic  school  sy  stem  as 
a  place  to  start  The  Springfield  system  is  large 
enough  to  present  a  broad  range  ol  challenges,  but 
not  too  large.  The  system  has  24.000  students  in  Til 
schools.  T  hirty -eight  percent  ol  the  students  arc 
white.  55  percent  Hispanic.  2n  percent  black,  and  2 
percent  Asian;  15  percent  of  the  students  are  in 
special  education  classes.  Currently .  more  than  40 
percent  ol  the  students  in  Springfield  drop  out  of 
school  before  graduating.  More  important,  the 
Springfield  school  administration  is  interested  in 
making  systemic  changes  to  improv  e  the  education 
for  all  students  and  is  willing  to  lake  risks  by  trying 
new  approaches.  In  IW|.  the  Springfield  school 
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department  began  to  explore  the  possible  uses  ol 
technology  throughout  the  school  system  anil 
ileteniiinei)  that  technology  eoulil  lx1  central  to  the 
success  ol  its  program  ol  school  renewal  in  a  number 
ol  important  ways. 

Work  With  a  School  System  That  Wants  To 
Improve 

Two  ami  a  half  vears  ago.  Springfield  began  a 
comprehensive  school  renewal  effort  with  a  plan  that 
has  a  single  goal:  to  offer  all  students  access  to 
ei|intv  and  academic  excellence,  regardless  ol  their 
ethnic,  social,  or  economic  backgrounds.  In  the  lirst 
two  phases  of  the  program.  Springfield  restructured 
its  schools  by  giv  ing  parents  far  more  educational 
options  than  they  had  in  the  past  while  at  the  same 
time  inoi  ing  the  system  further  toward  the  goal  of 
racial  balance.  Next,  they  totally  reorganized  the 
grade  structure  of  their  schools  by  creating  k  5 
elementary  schools,  middle  schools.  K  -X  schools, 
and  four  year  high  schools,  f  inally,  they  inaugurated 
school  based  management  in  all  4(1  schools.  Having 
implemented  these  first  steps  m  the  restructuring 
process.  Springfield  has  now  begun  a  third  phase  in 
school  renewal  which  is  focused  directly  on  making 
a  positive  impact  on  students  and  teachers  m  the 
classroom. 

Central  lo  this  latest  phase  ol  renewal  is  the  full 
implementation  of  a  solid  curriculum  that  specifies 
goals  and  outcomes  for  which  both  the  schools  anil 
the  students  are  accountable  Consequently.  Spring- 
held  has  begun  to  develop,  vv  ith  technical  help  from 
Mi  l  Rf  and  assessment  help  from  the  educational 
testing  Service  (I  IS),  an  assessment  system  that 
will  monitor  how  well  individual  students  and  the 
svstem  at  large  are  achicv  mg  the  goals  that  have 
been  set  in  all  curriculum  areas.  Springfield  is 
developing  its  own  assessment  svstem  because  the 
assessment  sy  stems  currently  available  to  schools 
are  madei|iiate  for  a  number  ol  reasons,  f  irst,  they 
assess  only  a  lew  ol  the  curriculum  areas  that 
schools  teach.  Second,  they  assess  only  a  small 
fraction  of  the  goals  and  objectives  that  are  covered 
bv  the  curriculum  areas  that  are  tested.  Finally,  the 
data  that  schools  do  gain  through  currently  available 
assessments  is  relatively  inaccessible  to  classroom 


teachers  and  is  therefore  largely  unusable  in  making 
day-to-day  educational  decisions  lot  students.  The 
appendix  describes  one  unsuccessful  attempt  to  meet 
Springfield’s  needs  w  ith  an  existing  assessment 
sy  stem. 

Springfield  has  recognized  that  if  schools  are  lo 
do  an  effective  job  of  teaching  all  students,  they 
must  do  a  much  better  job  of  managing  instruction. 

If  indiv  idual  students  are  not  achiev  ing,  teachers 
need  to  know  exactly  where  they  are  having  diffi¬ 
culty  so  they  can  intervene  quickly  with  new  forms 
of  instruction  to  help  them  attain  curriculum  goals.  If 
large  numbers  of  students  are  not  succeeding, 
teachers  also  need  to  know  that  quickly  so  they  can 
develop  new  ways  to  deliver  instruction  lor  whole 
classes. 

Technology  is  also  being  explored  as  a  method 
of  classroom  instruction  It  is  clear  that  the  class- 
room  of  the  future  will  make  regular  use  ol  a  variety 
of  technologies  for  direct  instruction  ol  all  students. 

It  is  also  clear  that  technology  will  help  school 
systems  meet  the  needs  of  students  who  have  not 
succeeded  in  traditional  educational  programs  o.e.. 
at-risk  students)  As  was  noted  earlier,  about  40 
percent  of  Springfield  students  currently  drop  out  of 
school.  The  system  cannot  accept  this  type  ol  failure 
Programs  must  be  developed  lo  keep  students  m 
school,  but  it  is  also  important  that  these  programs 
offer  students  a  quality  education  and  not  just  a 
diploma  granted  to  them  lor  seat  time.  Programs 
must  be  developed  that  incorporate  the  use  ol 
technology  and  are  targeted  foi  all  students,  w  hether 
they  are  at  risk  or  not.  The  programs  must  challenge 
students  and  offer  them  genuine  opportunities  to 
learn  the  skills  they  will  need  to  live  and  work  in  the 
2 1  st  century . 

Springfield's  goal  is  to  develop  competency  - 
based  alternative  programs  that  take  advantage  of 
computers  where  apptopriate  to  help  manage  the 
educational  process  and  to  help  deliver  instructional 
material.  This  will  give  students  who.  for  one  reason 
or  another,  are  not  succeeding  in  traditional  pro¬ 
grams  the  opportunity  to  learn  required  material  at 
their  own  pace.  Teachers  w  ill  still  play  a  central  role 
in  the  education  of  these  students.  The  teachers  mav 
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use  a  computer  lo  help  monitor  student  progress 
through  the  curriculum,  but  they  must  also  establish 
ongoing,  caring  relationships  with  the  students.  A 
computer-based  management  system  can  help  keep 
alternative  programs  such  as  this  one  anil  the 
students  in  them  -  firm!)  connected  to  the  curricu¬ 
lum  and  to  the  school  s\  stein  that  is  accountable  lor 
its  quality . 

A  computerized  curriculum  management  and 
assessment  scstem  is  at  the  heart  ot  Springfield's 
attempt  to  oiler  all  students,  regardless  o!  their 
individual  needs,  the  academic  programs  they 
require  lor  success.  It  is  basic  to  school  renewal  I  or 
mainstream  students,  it  offers  constant  feedback, 
allowing  teachers  to  make  adjustments  m  the  content 
or  deliverv  of  lessons,  for  students  with  special 
needs,  it  keeps  them  within  the  curriculum  in 
substantive  programs,  focused  on  outcomes  they 
need  to  learn  it  tliev.  too.  are  to  receive  a  quality 
education  that  will  mean  something  ill  the  market 
place.  In  fact .  such  a  scstem  will  become  the 
foundation  for  a  If  the  programs  developed  tri 
Springfield  and  for  all  further  use  of  technologc 
because  it  will  interrelate  and  give  teachers  and 
administrators  access  to  a  number  ol  important 
databases.  The  student  database,  winch  is  currently 
isolated  from  instructional  data,  can  be  incorporated 
into  the  total  informational  grid.  Information  on 
student  achievement  could  be  merged  with  other 
student  data  and  readily  retrieved  and  shared  with 
teachers,  students,  and  parents.  Teachers  throughout 
the  s\  stem  would  have  timely  information  on 
instructional  resources  that  could  be  Used  to  leach 
specific  curriculum  goals  and  ohiecln cs  Computer 
managed  instruction  would  produce  a  llow  ol 
information  for  use  throughout  the  entire  system 

Create  an  Industry  Tine  eminent  Partnership 

Manv  of  the  ideas  in  this  paper  have  come  from 
MITRI.'s  work  tor  Ms  government  sponsors, 
including  work  on  the  development  of  computer- 
based  training  sv  stems  for  the  military .  Mi  l  Rfi's 
area  ol  expertise  is  information  system  technologc 
computers,  soltvcare.  communication  systems, 
etc  lor  a  wide  rangy  ol  defense  and  non  defense 
applications  MITRIi  is  pursuing  the  application  ol 


technology  to  the  public  schools  as  a  /no  hmi<‘ 
activity  consistent  with  its  role  as  a  not-lor -profit 
corporation  that  engages  in  scientific  and  technical 
activ  Hies  for  the  public  good.  However,  the  initiative 
w  ill  need  the  resources  of  other  organizations  if  it  is 
to  succeed.  The  Air  force.  specifically  the  Idcctromc 
Systems  Center  (f-iSC)  of  the  Air  l-orce  Materiel 
Command,  will  he  a  partner  with  MITRIi.  The 
defense  department  and  the  Air  force  are  leaders  m 
the  application  of  technology  to  training  and 
educational  purposes,  and  there  is  a  desire  and  an 
opportunity  to  transition  technology  that  lias  been 
developed  (or  defense  applications  to  the  civ  than 
sector.  I  SC  is  the  organization  responsible  lor  the 
development  ol  advanced  Air  force  information 
sy  stems. 

Both  I  SC  and  MITRIi  are  located  in  Massachu¬ 
setts.  w  Inch  is  the  home  of  major  computet  mamduc 
Hirers,  software  companies,  and  other  high  tcclmol 
ogy  industry  As  die  initiative  proceeds,  we  expect 
that  a  number  of  companies  w  ill  also  participate 
H'liile  their  initial  partn  iputton  may  be  to  contribute 
goods  or  services,  the  reason  why  industry  panic tp.t 
turn  is  critical  goes  beyond  that.  1  he  theme  ol  this 
paper  has  been  the  tundamental  importance  ol 
standards  for  edueation.il  technology  products 
Industry  is  the  developer  and  supplier  of  those 
products.  By  having  industry  involved  Irom  the 
beginning,  the  resulting  standards  and  open  system 
architectures  will  hopefully  he  viewed  as  steps  that 
open  new  markets  and  therefore  stimulate  the 
development  of  more  and  heller  products 

f  ollow  an  evolutionary  Approach 

111  e  overall  objective  is  to  create  a  structure  and 
approach  lor  educational  technology  that  can  be  used 
throughout  a  school  system  and  eventu  illv  through 
out  the  state  and  the  nation.  However,  that  objective 
will  lake  lime  since  it  depends  upon  both  the  rate  at 
which  the  necessary  infrastructure  can  be  developed 
and  juii  into  place,  and  the  rate  at  which  the  schools 
can  assimilate  the  changes.  Iherelore.  we  will  begin 
with  some  specific  activities  that  mav  he  limited  in 
scope  but  can  serve  to  demonstrate  and  verify  the 
basic  concepts,  and  we  will  do  that  within  the 
context  of  an  overall  v  ision  of  what  we  hope  to 
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accomplish  aiut  a  lone  term  plan  lor  growth  and 
expansion  Our  near  term  activities  include: 

•  C  rcaimg  several  teehnologv -based  classrooms 
or  an  cducalinna!  teehnologv  resource  eenler  in 
a  Springfield  school  dining  llte  I'WM'N' 
school  \ear.  1  liesc  will  include  a  substantial 
number  of  computers  lor  students  and  the 
teacher,  interconnected  with  a  local  area 
network  1 1  \N  i  and  connected  to  external 
communication  networks  as  well  Thev  max 
also  include  multimedia  deuces  such  as  00 

R(  >\ls  and  interactiN e  \  ideodisks  Oil lerent 
educational  software  packages  and  tools  would 
be  integrated  in  \anous  wa\s  and  to  various 
decrees  to  explore  the  impact  ol  diflerent  user 
interfaces  upon  students  and  teachers. 

•  Creating  a  rapid  proton pe  ol  a  computerized 
curriculum  management  and  assessment  swetn 
lit, it  could  he  used  to  evaluate  the  utility  of  an 
expanded,  accessible  database  on  student 
performance  as  a  monitoring  and  diagnostic  tool 
foi  the  classroom  teacher  This  prototype  might 
deal  w  tth  a  single  class. tew  classes  w  ithin  a 
single  school,  or  an  entire  school  Regardless  ot 
the  initial  scope,  the  underlying  design  must 

re! leci  and  accommodate  the  educational 
curriculum  and  be  scalable  to  permit  expansion 
throughout  the  entire  school  system  once  the 
concepts  and  requirements  are  tinned  up 
through  evaluations  with  the  prototype. 

•  Integrating  the  prototype  computerized 
curriculum  management  and  assessment  system 
with  the  educational  software  packages  in  the 
teehnologv  based  classrooms  to  pros  ide  a 
vehicle  for  developing  and  evaluating  both 
trout  end  and  back  cud  interlaces  in  an 

m '  .’grated  student  to  assessment  system 
en\  iromnent 

•  f  renting  an  easily  accessible  repository  ol 
educational  technology  materials  i software, 
courseware,  video,  audio,  etc.i  within  a  school 
that  would  include  not  only  the  materials 
themselves  hut  also  descriptive  information 
about  them  and  evaluations  hv  prior  users  to  aid 


students  and  teachers  who  arc  seeking  material 
lor  classroom  use  ot  supplementary  rclercncc 
The  repositorv .  which  might  reside  in  a  com 
puter  in  the  technology  based  classroom,  would 
also  he  extensible  hv  the  users  so  that  thev  could 
add  to  the  evaluation  database  to  reflect  then 
own  experience  and  suggestions. 

•  Preparing  a  master  plan  lor  the  sxstemte  use  ot 
educational  technology  in  the  school  system  m 
accordance  with  the  concepts  described  ear! ict 
in  tins  paper  open  system  architectures  and 
standard  interlaces,  sharing  and  reusing 
educational  software  trom  main  sources, 
consistent  and  user  friendly  computet  interfaces, 
and  a  technical  support  infrastructure  that  takes 
lull  advantage  ol  resources  in  the  schools 
themselves. 

Help  the  l  eat  hers 

Teacher  commitment  and  early  involvement  are 
essential  it  any  <>l  these  efforts  are  to  succeed.  We 
w  ill  bring  the  classroom  teachers  into  the  partnership 
in  two  ways:  hv  providing  training  on  modern 
information  system  technology,  and  by  providing 
tools  to  help  with  portions  of  the  teachers'  workload 
Modern  office  automation  tools  such  as  word 
processing,  spreadsheets,  computer  graphics,  and 
electronic  mail  can  help  the  teachers  in  some  of  the 
administrative  parts  of  their  jobs.  Other  tools  such  as 
the  computerized  curriculum  management  and 
assessment  system  described  earlier  can  help  the 
classroom  teacher  concentrate  on  the  ov  erall 
management  of  the  educational  process  tor  each 
indiv  idual  student. 

The  industry/gov  ernment  partnership  described 
earlier  represents  a  substantial  amount  of  technical 
expertise  that  can  be  tapped  for  initial  training  and 
technical  support.  The  teachers  who  will  use  the 
technology  will  be-  involved  in  the  planning  and 
development  process  so  that  thev  will  he  comfort¬ 
able  using  the  products  in  the  classroom  We  have 
already  taken  the  first  step  in  that  direction  with  a 
■Technology  in  Education"  workshop  at  Mi  l  RH  tot 
lb  Springfield  teachers  this  summer.  We  will  foster 
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continued  participation  h\  working  in  ihe  schools 
with  the  teachers  during  the  planning  phase  to 
understand  firsthand  the  challenges  and  the  opportu¬ 
nities.  W  e  u  ill  also  continue  to  hnng  selected 
teachers  to  mdusirx  lor  summer  internships  that  will 
pros  ide  firsthand  exposure  to  the  kinds  of  technol 
og>  that  can  he  applied  to  the  schools,  further 
training  in  ihe  use  of  that  technologx.  and  work  on 
the  detailed  planning  and  implementation  ol  subse¬ 
quent  phases  of  this  program. 
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APPENDIX 

EXPERIENCES  WITH  ONE  COMPl  I  ERIZE1) 
ASSESSMENT  SYSTEM 

Prior  to  MITRE's  involvement,  Springfield 
made  an  initial  attempt  to  implement  a  computerized 
curriculum  management  and  assessment  system  lor 
the  Springfield  schools,  based  on  adapting  an 
existing  commerciallv  available  software  package  to 
that  purpose.  The  existing  package  permitted  users 
t teachers)  to  define  and  maintain  a  database  of 
learning  objectives  for  each  grade  and  subject.  Test 
questions  keyed  to  the  learning  objectives  could  be 
entered  and  stored  in  a  database  and  then  used  by 
teachers  to  create  tests.  Test  results  and  other  teacher 
assessments  could  be  entered  and  various  reports 
could  be  generated  to  assess  student  performance  as 
well  as  the  curriculum.  The  package  also  permitted 
the  users  to  create  a  database  of  resources  keyed  to 
the  learning  objectives. 

(Tne  of  Springfield’s  first  requests  for  MITRE 
support  was  to  help  determine  if  the  package  they 
had  purchased  would  be  adequate  as  a  system-wide 
assessment  system.  After  meeting  with  teachers 
involved  in  a  pilot  test  ol  the  package,  it  was  found 
that  the  package  was  never  used  very  widely  within 
the  school  system  for  a  variety  ol  reasons: 

•  I  he  user  interface  was  complex  and  difficult  to 
use.  T  he  original  version  of  the  commercial 
software  package  was  released  in  ITT').  The 
user/sv  stem  interface  was  similar  to  other 
software  developed  in  that  time  frame,  with 
many  levels  of  menus  and  function  key  s  to 
select  options.  f'sers  were  required  to  make 
many  selections  to  access  a  desired  functional 
capability  (e  g.,  to  find  a  test  question  keyed  to 
an  instructional  objective i.  In  many  cases,  (lie 
user  had  to  repeat  the  same  process  to  make 
multiple  selections  le.g..  to  create  a  complete 
test  that  covered  multiple  objectives).  The  depth 
of  the  menus  also  required  effort  to  learn  anil 


was  easy  to  forget.  Newer  sv stems  provide 
graphical  user  interfaces  that  are  much  more 
intuitive  and  easier  to  use. 

•  The  existing  software  package  did  not  allow  a 
user  to  generate  products  te.g..  a  set  of  test 
questions  or  report)  that  could  be  exported  to  a 
word  processor  for  editing.  Teachers  had  to 
print  the  test  questions  from  the  computer's 
database  on  paper  and  then  literally  cut  and 
paste  to  create  a  test. 

•  The  existing  package  did  not  prov  ide  the 
capability  to  generate  and  store  graphics  le.g.. 
charts,  graphs)  with  test  questions.  Therefore, 
any  graphics  associated  with  a  test  question  had 
to  be  storeil  in  a  separate  physical  file,  or  there 
had  to  be  enough  information  in  the  test 
question  to  enable  the  teacher  to  construct  the 
graphic  manually . 

•  The  software  package  had  limited  information 
security  provisions.  It  provided  access  privileges 
to  users  by  location,  where  a  location  corre¬ 
sponded  to  a  school.  If  a  user  was  given  read, 
write  access  to  a  location,  he/she  could  access 
and  modify  all  of  the  teacher  files  for  that 
location.  Only  the  "owner"  of  an  indiv  idual  file 
should  be  able  to  modify  the  contents  of  that 
file,  and  only  a  subset  of  the  users  at  any 
location  should  be  permitted  to  examine  an 
indiv  idual  file. 

•  T  he  database  for  this  curriculum  management 
and  assessment  system  could  not  interact  with 
the  student  database.  The  commercial  package 
could  import  initial  files  of  student  and  teacher 
data  to  set  up  its  internal  databases.  However, 
after  the  initial  setup,  the  databases  had  to  he 
updated  independently,  furthermore,  the  pack¬ 
age  could  not  export  data  to  another  database. 
Providing  a  database  export  capability  would 
have  required  custom  software  development 
which  the  school  system  was  unable  to  do. 
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Tilt*  basic  ci incepts  underlying  the  commercial 
software  package  li.e..  defining  learning  objeelives. 
and  keving  oilier  information  to  the  learning 
objectives)  acre  consistent  with  the  school  system's 
objeelives.  However,  limitations  in  the  implementa¬ 
tion  made  the  package  very  difficult  to  use  and 
required  an  inordinate  amount  of  additional  manual 
activ  ity.  Teachers  were  reluctant  to  learn  the 
complex  interlace  and  became  frustrated  by  the 
amount  of  effort  required.  The  lack  of  information 
security  also  raised  questions  about  student  privacy 
rights  and  concents  over  tampering  with  data, 
finally.  the  inflexibility  of  the  implementation  made 
it  verv  difficult  to  modify  the  package  as  the  school 
system's  needs  changed.  I'nfortunately.  these 
limitations  were  only  obvious  after  an  extended  trial. 
In  retrospect,  this  experience  illu  urates  two  of  the 
challenges  to  be  faced  in  applying  technology  in  the 
public  schools:  1 1 )  the  difficulty  ol  selecting  a 
software  package  that  will  provide  the  capabilities 
that  are  needed  for  a  specific  apnlication.  that  is  easy 
to  use.  that  can  be  integrated  into  a  larger  total 
operating  environment,  and  that  will  provide  a  path 
lor  growth  and  adaptation:  and  |2>  the  importance  ol 
prov  id i nii  adequate  training  and  continued  technical 
support  lot  the  enil  users  of  software  packages. 


